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(57) Abstract: A system and method for identifying and 
establishing preferred modalities or channels for communi- 
cations based on participants' s preferences and capabilities 
is provided. In one approach, the system attempts to opti- 
mize the interred or directly accessed preferences of a con- 
tactee given the accessed or inferred preferences, capabili- 
ties and goals of the contactor while keeping the rationale 
and context of the contactee private. Such optimization can 
be achieved using preferences and policies concerning han- 
dling the attempted contact based on a deterministic speci- 
fication or through inferring context, content and task under 
uncertainty by employing decision- theoretic inferences to 
attempt to maximize the expected utility of the communica- 
tion to the contactee. The methods may include a considera- 
tion of metadata within a standard schema that is transmitted 
along with a communication attempt, representing informa- 
tion about such attributes as the identity of the contactor, 
the task at hand, the overall context of the contactor, and 
the communication capabilities available to the contactor. 
The invocation of the communication service may be per- 
formed in a variety of ways, including single button invoca- 
tions, and via a communication service that is more deeply 
integrated with other applications and functionalities. The 
service can also include automated rescheduling of commu- 
nications based on a consideration of forecasts of availabil- 
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Title: System and Method For Identifying and Establishing Preferred 

Modalities or Channels for Communications Based on Participants' 
Preferences and Contexts 

Cross-Reference to Related Application 

This application is a continuation-in-part of U.S. Patent Application Serial No. 
09/809,142, which was filed March 15, 2001, entitled System and Method For 
Identifying and Establishing Preferred Modalities or Channels for Communications 
Based on Participants' Preferences and Contexts. 

Technical Field 



The present invention relates generally to policies, including, in one example 
of the system, decision-theoretic policies, for identifying and establishing data 
communications and more particularly to facilitating optimal communication links 
1 5 between contactors and contactees based on deterministic and/or uncertain contactee 

and/or contactor preferences, capabilities and context, both present and predicted. 

Background of the Invention 

As the number of possible communication modalities between contactors and 

20 contactees has increased, it has become increasingly valuable to identify and choose 

optimal channel(s) by which communications are carried out to facilitate maximizing 
the utility of a data communication. For example, communi eating parties may be able 
to communicate by computer (e.g., email, voice over IP, collaborative editing), by 
telephone (e.g., POTS, cell phone, satellite phone), face to face (e.g., personal 

25 meeting, video conference) and/or other methods, with such communication 

employing one or more channels (e.g., phone and collaborative editing). Maximizing 
the utility or expected utility of such communications may depend on the identity of 
the parties, the type of communication equipment available to the parties, the type of 
equipment used to do the initial signaling, the location of the parties and in what 

30 activities, if any, the parties are engaged or are likely to be engaged in the future. 

By way of illustration, a first contactee may be employing a first tool and be 
intensely focused on an important task and thus may not desire to be interrupted via 
real-time communications except from select people whose desired communication 
concerns the important task. But a second contactee may be employing no tools and 

35 be lightly focused on an unimportant task and thus may not mind being interrupted via 
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real-time communications from colleagues concerning a variety of topics. 
Conventionally, the contactor had limited means, if any, to determine which, if any, 
communication method(s) would be best employed to communicate with a contactee 
(e.g., contacting the contactee's secretary to figure out how and when to contact the 
5 contactee). Similarly, the contactee had limited contact control methods (e.g., leaving 

the phone off the hook, ignoring emails, disabling an email application, leaving 
instructions with a secretary). Thus, the preferences and needs of the contactees and 
contactors may not have been observed. 

Beyond considerations of real-time methods versus methods that allow users 

10 to send potentially disruptive real-time disruptions into an asynchronous (store and 

forward) communication format (e.g., voicemail, email), a contactee may have 
preferences, depending on the contactor and the context at hand, for a particular 
modality. For example, a contactee may prefer to receive an instant message on an 
important document while working on that document to facilitate cutting and pasting 

1 5 from the instant message, rather than receiving a real-time phone call that would 

require transcribing the caller's comments. Again, conventionally the contactee had 
limited means, if any, to have such preferences observed (e.g., a well-trained 
secretary, considerate colleagues) which often lead to unfulfilled preferences and 
unwanted interruptions. 

20 While conventional communications between two communicating parties was 

complicated, identifying and scheduling communications that optimized the utility of 
a communication between multiple parties (e.g., group meeting, group teleconference) 
was even more complicated, with the identification, scheduling, and initiating often 
consuming more time and resources than the actual communication. Such scheduling 

25 and initiating problems were exacerbated when the schedulers and initializers did not 

have complete information concerning the parties. 

Summary of the Invention 

The following presents a simplified summary of the invention in order to 
30 provide a basic understanding of some aspects of the invention. This summary is not 

an extensive overview of the invention. It is not intended to identify key or critical 
elements of the invention or to delineate the scope of the invention. Its sole purpose 
is to present some concepts of the invention in a simplified form as a prelude to the 
more detailed description that is presented later. 
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The present invention relates to a system and method for determining optimal 
communication modalities between contactors and contactees based on information, 
either complete or incomplete, associated with the contactees and/or contactors. To 
preserve the privacy of the contactee, contactee information employed in determining 
5 the optimal communication modality may typically not be shared with the contactor. 

Based on the identified optimal communication modalities, one or more 
communications may be scheduled, calendared and/or initiated in real-time between 
the contactor and contactee. The scheduled communication may rely on the current 
context and capabilities of the communicating parties and/or on predictions 

1 0 concerning the likelihoods that different communication modalities will become 

available and/or communicating party contexts will become more optimal. 
Alternatively and/or additionally, the present invention may display to the contactor 
the contactee 5 s current list, ranked in order of preference based on the information 
being considered. In other situations, a best means may be displayed, or simply 

1 5 invoked. 

The method can consider the optimization of a measure of priority or value for 
communicating parties and additionally and/or alternatively, for the contactee 
(including the contactee's preferences about the contactor's preferences). In another 
example aspect of the present invention, one or more policies may be established 
20 according to the policies of an organization, considering the preferences of contactees 

and contactors, but combining these at the level of the enterprise employing the 
participants. 

Considering now a method whereby the selected communication satisfies a set 
of polices specified by the contactee(s), and secondarily (via preferences of the 

25 contactee about the contactor's preferences) that of the contactor(s) concerning 

communications. In a general formulation of this method, given communication and 
collaboration preferences expressed as utility functions, beliefs about context, content 
and communications expressed as probability distributions, and a set of decision 
alternatives concerning communications (e.g, 3 establish a real-time telephony 

30 connection now, pop up an email composition form on the contactor's screen, route 

the contactor to voicemail, etc.), the decision making system should choose that 
course of action that maximizes the expected utility of the communication. In one 
example aspect of the present invention, the recipient of the communication is 
considered as the principal agent since it is the recipient's attentional resources that 
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are requested by the contactor. But the preferences of the contactor may also be 
considered in an attempt to maximize the utility of the communication to the 
contactor within the constraints imposed while maximizing the utility to the contactee. 
Further, in an automated setting, where the contactor is communicating with an 
5 automated contactee, the present invention can disregard the utility of the 

communication to the contactee and establish maximizing the utility of the 
communication to the contactor as the primary goal. 

The optimal communication modalities may be based on factors including, but 
not limited to, available communication channels (including single versus multiple 

10 simultaneous channels), the tool used in an initial attempt to communicate, the 

contactee preferences, contactor preferences, specially identified time periods, 
groupings of contactors, contactee context, contactor context, contactee 
communication needs, contactor communication needs, contactor communication 
goals, schedules, priorities, deadlines, costs, benefits, contactee capabilities and 

1 5 contactor capabilities, for example. 

By way of illustration, a speechwriter working on the state of the union 
address may have several communication modalities through which she can be 
contacted (e.g., in person, by phone, by email, by cooperatively editing the speech, by 
pager). Up to two weeks before the speech, when time is not so critical, the 

20 speechwriter may be willing to accept communications from persons in different 

categories via different types of communications modalities. For example, the 
speechwriter may prefer real-time communications (e.g., telephone, cooperative 
editing) from a first group of persons (e.g., President, White House staff, certain 
family members) with the type of real-time communication being based in part on 

25 where the speechwriter is located and what the speechwriter is doing. For example, 

the speechwriter may prefer a phone call when not working on the document, may 
prefer a phone call and a joint computer screen link for cooperative editing while 
working on the document and may prefer high priority email and/or mobile paging 
while at work but away from her desk. These preferences may be intended by the 

30 speechwriter to facilitate maximizing the utility of the communication to the 

speechwriter and/or to customize the work environment to the contactee's desires, for 
example. Similarly, the speechwriter may prefer non-real-time communications (e.g., 
low priority email) from a second group of persons (e.g., specific members of 
Congress, certain press, and certain close friends) so that her workflow is not 
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interrupted, again attempting to maximize the utility of communications and 
customize the workplace. 

In one example aspect of the present invention, when a contactor wishes to 
communicate with a contactee, the contactor may employ the present invention to 
5 identify communication modalities and present ranking information concerning the 

modalities based on maximizing the utility of the communication with the contacted 
Such utility calculations may consider both current conditions and probabilities 
associated with future conditions. By way of illustration, if the President wants to 
contact the contactee concerning the speech, then substantially all methods of 

10 communication may be available to contact the contactee, and the method that will 

provide the most immediate feedback may be selected. For example, if the 
speechwriter is at her desk, working on the speech, then cooperative editing with a 
simultaneous voice channel and shared computer screen may be selected. But if the 
speech writer is in her car (as determined by GPS, for example), then although an 

1 5 immediate cellular phone call may maximize the immediacy of the communication, a 

phone call delayed for ten minutes until the speechwriter arrives home and has her 
laptop available for transcribing and/or editing may produce a higher utility. If the 
speech writer is outside cellular coverage, and has no satellite phone available, then a 
runner may be dispatched with the message. By way of further illustration, if the 

20 speech- writer's veterinarian wishes to contact the contactee a month in advance 

concerning a reminder about an optional office visit for a healthy pet, then low 
priority email and/or a low priority voice mail may be chosen to maximize utility. As 
the illustrations point out, there can be a large number of variables to evaluate in 
determining the communication that will maximize utility. 

25 The rich set of data concerning the contactee and/or contactor can be 

employed by the present invention to facilitate determining the communication 
modality that will maximize the utility of the communication. Sometimes the present 
invention may reason concerning the optimal communication modality with complete 
data, but at other times, since the set of data is large and complex, the present 

30 invention may sometimes reason concerning the decision under uncertainty. For 

example, the decision-making system may only have a belief, represented as a 
probability distribution, concerning the likelihood that a contactee is in a certain 
attentional state. Such a belief maybe computed dynamically as a function of 
information from sources including, but not limited to, the contactee's calendar, 
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desktop activity, ambient acoustics in the contactee's location and video analysis of 
the contactee's gaze or local activity, for example. Inferred likelihoods about a 
contactee's attention, location, and other aspects of a contactee's context maybe 
employed to drive dynamic decision making about communications, motivated by an 
5 attempt to select actions that maximize the contactee's expected utility. Thus, the 

present invention can determine the optimal communication modality given multiple 
observations about the contactee and/or contactor contexts. 

The present invention facilitates using multiple decision-making methods, 
where the best method is selected in different situations. For example, one decision 

1 0 may be made using simple priority rules, another by a policy that takes as input key 

aspects of the contactee's preferences and the communication preferences of the 
contactee and/or contactor. In another case, a decision may be made employing 
decision-theoretic reasoning concerning the value of the communication given a 
consideration of the uncertainties about the context. In addition, the decisions can be 

1 5 made sensitive to dates and times, considering specific assertions about particular 

time horizons to guide communications. For example, a contactee may attach great 
importance to communications occurring before a point in time {e.g., a speech being 
delivered) but then may attach very low importance to such communications for the 
following month. 

20 In another example aspect, the contactor may specify desired modalities and 

allow the present invention to maximize communication utility within the specified 
modalities. Although contactors can choose an initial communication modality, the 
contactor can be referred {e.g,, by a message, by automated routing), to the preferred 
modality. In one example aspect of the present invention, communication devices 

25 (e-g-> phones, computer screens, faxes) can include a "BestCom" button that initiates 

optimizing communication modalities and which removes the need for tire contactor 
to make decisions concerning modality and routing, with such decisions made by the 
present invention. Given the availability of such a service, a potential future 
contactee may request that the potential future contactor utilize the present invention 

30 to contact the contactee when attempting future contacts. 

The present invention is not limited to communications between two parties or 
to a single communication channel between two parties. It is to be appreciated that 
multiple channels and/or multiple communicating parties can be treated as increased 
sets of alternatives that may complicate utility maximizing computations without 
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changing the fundamental process of identifying and establishing one or more 
communication modalities based on the preferences, contexts and capabilities of the 
communicating parties. 

Yet another aspect of the present invention considers the value of delaying the 
5 communication and rescheduling it for a later time via an automated system that scans 

calendars and inferred availability information — or via establishing private dialogs 
with each potential participant, for example. As an example, assume that a contactor 
attempts to contact a contactee in real-time and the contactee is in an important 
meeting. The best option {e.g., one that maximizes utility) may be to reschedule a 

1 0 real-time conversation when the contactee is predicted to be back from meeting, based 

on calendar information or statistics concerning the contactee's comings and goings 
that facilitate predicting the contactee' s likely availability. One aspect of the present 
invention may consider the calendar of the contactor to arrange a mutually good time. 
Another aspect of the present invention facilitates presenting information to 

1 5 contactors and/or contactees and engaging them in a dialog to facilitate scheduling a 

communication. The dialog may produce entity selection data concerning the 
communication, where such data can be employed to choose between possible 
communication modalities. Such interactions can similarly be employed to schedule 
group meetings where the cost of delay {e.g., estimated loss in value of the 

20 information being transmitted), the current attentional states of the contactor(s), the 

current attentional states of the contactee(s), the potential attentional states of the 
contactor(s), the potential attentional states of the contactee(s), the availability of 
other modalities, the current availability of contactee(s) and the potential availability 
of the contactee(s) are considered. 

25 The present invention includes methods for predicting the likelihood of when 

contactee(s) may be available, where such likelihoods can be employed in scheduling 
group meetings where the utility of the group experience of the n participants, n being 
an integer, is maximized. For example, calendars for the n participants can be 
examined to infer times at which the participants are likely to be available to share in 

30 some common modalities {e.g., videoconferencing, collaborative editing). In other 

cases, there may be automated analysis about the best way to engage in a group 
meeting when a subset of participants will not have access to the same more ideal 
modality than the others. In such situations, a decision may be made to limit the 
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methods (e.g., forego video links) so as to maintain an equivalent relationship among 
participants. Automated meeting request(s) can be constructed from such analysis. 

To the accomplishment of the foregoing and related ends, certain illustrative 
aspects of the invention are described herein in connection with the following 
5 description and the annexed drawings. These aspects are indicative, however, of but a 

few of the various ways in which the principles of the invention may be employed and 
the present invention is intended to include all such aspects and their equivalents. 
Other advantages and novel features of the invention may become apparent from the 
following detailed description of the invention when considered in conjunction with 
10 the drawings. 

Brief Description Of The Drawings 

Fig. 1 is a schematic block diagram illustrating a system for identifying an 
optimal communication based on the preferences, capabilities, contexts and goals of 
15 the parties to engage in the communication, in accordance with an aspect of the 

present invention. 

Fig. 2 is a schematic block diagram illustrating a system for identifying and 
establishing an optimal communication based on the preferences, capabilities, 
contexts and goals of the parties to engage in the communication, in accordance with 

20 an aspect of the present invention. 

Fig. 3 is a schematic block diagram further illustrating a system for identifying 
and establishing an optimal communication based on the preferences, capabilities, 
contexts and goals of the parties to engage in the communication, in accordance with 
an aspect of the present invention. 

25 Fig. 4 illustrates an environment in which the present invention may be 

employed. 

Fig. 5 is a flow chart illustrating one particular methodology for carrying out 
an aspect of the present invention. 

Fig. 6 is a flow chart illustrating another methodology for carrying out an 
30 aspect of the present invention. 

Fig. 7 is a schematic block diagram of an exemplary operating environment 
for a system configured in accordance with the present invention. 

Fig. 8 is a schematic block diagram illustrating context awareness processing 
in accordance with an aspect of the present invention. 
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Fig. 9 illustrates processing associated with a contactor attempting a 
communication, in accordance with an aspect of the present invention. 

Fig. 10 illustrates a contact system and associated methodology for 
establishing communications between an unsolicited contactor and a contactee in 
5 accordance with an aspect of the present invention. 

Detailed Description 

The present invention is now described with reference to the drawings, 
wherein like reference numerals are used to refer to like elements throughout. In the 

10 following description, for purposes of explanation, numerous specific details are set 

forth in order to provide a thorough understanding of the present invention. It may be 
evident, however, to one skilled in the art that the present invention may be practiced 
without these specific details. In other instances, well-known structures and devices 
are shown in block diagram form in order to facilitate description of the present 

1 5 invention. 

As used in this application, the term "component" is intended to refer to a 
computer-related entity, either hardware, a combination of hardware and software, 
software, or software in execution. For example, a component may be, but is not 
limited to being, a process running on a processor, a processor, an object, an 

20 executable, a thread of execution, a program and a computer. By way of illustration, 

both an application running on a server and the server can be components. One or 
more components may reside within a process and/or thread of execution and a 
component may be localized on one computer and/or distributed between two or more 
computers. 

25 It is to be appreciated that various aspects of the present invention may 

employ representations of deterministic policies specified as functions or rules that 
take as arguments contextual information, details about the nature of the participants, 
and the content or task at hand. The present invention may also employ technologies 
associated with facilitating inference and decision making under uncertainty and 

30 optimization of expected utility and/or minimization of expected costs. Thus, 

statistical inference may be performed with models constructed by hand, from data 
with machine learning methods, or by a mixture of machine learning and human 
assessment. Such models can be used in conjunction with deterministic policies 
where depending on the context, an inferential rule or deterministic rule is used. A 
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variety of machine learning systems/methodologies {e.g., Bayesian learning methods 
that perform search over alternative dependency structures and apply a score (such as 
the Bayesian Information Criteria, etc.) methods, Bayesian classifiers and other 
statistical classifiers, including decision tree learning methods, support vector 
5 machines, linear and non-linear regression, and neural network representations, etc.) 

may be employed to build and update inferential models. 

Referring initially to Fig. 1, a system 100 for identifying an optimal 
communication modality based on the preferences, context, capabilities and goals of 
the parties to engage in the communication is illustrated. The system 100 facilitates 

10 establishing a communication 110 between a contactor 120 and a contactee 130. 

While one contactor 120 and one contactee 130 are illustrated, it is to be appreciated 
that the system 100 may be employed to identify optimal communication modalities 
between two or more communicating parties. It is to be further appreciated that a 
party to the communication 110 may be a human or may be an electronic process. 

1 5 The communication 110 may be achieved through a variety of modalities 

including, but not limited to, telephone modalities, computer modalities, hardcopy fax 
modalities, paging modalities and personal modalities, for example. Data concerning 
the modalities may be stored in a communication modality data store 115. The 
communication modality data store 115 can hold information including, but not 

20 limited to, modalities available, cost for communication using that modality, 

likelihood modality will become available, modality capacity and modality reliability, 
for example. The system 100 may consider modalities that are currently available to 
establish the communication 110 and may also consider predictions concerning 
modalities that may become available to establish the communication 110. For 

25 example, a computer may not be currently available, because it is turned off, but it 

may become available later, when the user of the computer arrives at work and turns it 
on. The telephone modalities can include, but are not limited to POTS telephony, 
cellular telephony, satellite telephony and Internet telephony. The computer 
modalities can include, but are not limited to email, collaborative editing, instant 

30 messaging, network meetings, calendaring and devices employed in home processing 

and/or networking. The personal modalities can include, but are not limited to 
videoconferencing, messengering and face-to-face meeting. Data concerning a 
current modality {e.g., a phone that is busy) may be analyzed, as may data concerning 
the likelihood that the modality may become available {e.g., phone will no longer be 

10 
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busy). Identifying the optimal communication may, therefore, include considering the 
benefits of establishing the communication 1 10 at a first point in time, with the 
communication modalities available at that point in time, and considering the costs of 
delaying establishing the communication 1 10 to a second point in time when other 
communication modalities may be available. 

A contact manager 140 is employed to identify and determine which 
modalities can be employed for the communication 110 between the contactor 120 
and the contactee 130. To facilitate identifying the modalities and to farther facilitate 
determining which of the modalities should be employed for the communication 110, 
and at what point in time the communication should be attempted, the contact 
manager 140 has access to a contactor data store 150, a contactee data store 160 and a 
modality data store 115. The contactor data store 150, the modality data store 115 
and the contactee data store 160 can store data in data structures including, but not 
limited to one or more lists, arrays, tables, databases, stacks, heaps, linked lists and 
data cubes. The contactor data store 1 50, the modality data store 115 and the 
contactee data store 160 can reside on one physical device and/or may be distributed 
between two or more physical devices (e.g., disk drives, tape drives, memory units). 
Further, the contactor data store 150, the modality data store 115 and the contactee 
data store 160 may reside in one logical device and/or data structure. Similarly, the 
contact manager 140 can be distributed between two or more cooperating processes 
and/or reside in one physical or logical device (e.g., computer, process). 

In one example of the present invention, the contactee data 160 is not made 
available to the contactor 120, while one or more portions of the contactor data 150 
are made available to the contactee 130. Thus, the privacy of the contactee 130 may 
be protected and the identity of the contactor 120 maybe revealed. 

The contactor data 150 may include current state information, predictions 
concerning future states and costs associated with delaying a communication to points 
in time associated with the predictions concerning future states. Similarly, the 
contactee data 1 60 may include current state information, predictions concerning 
future states and costs associated with delaying a communication to points in time 
associated with the predictions concerning future states. For example, the contactee 
data 160 may include information concerning the current attentional status of the 
contactee 130 (e.g., in conversation on the phone concerning an assigned task) and 
may also include information concerning predicted attentional states of the contactee 
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130 at one or more future points in time (e.g., 25% likelihood contactee 130 in same 
state in five minutes, 50% likelihood contactee 130 in lower attentional state in ten 
minutes). 

The contact manager 140 may therefore examine the communication modality 
5 data 115, the contactor data 1 50 and the contactee data 160 when performing 

processing associated with identifying the modality that will maximize the utility of 
the communication 110 between the contactor 120 and the contactee 130. While one 
communication 1 10 is illustrated, it is to be appreciated that one or more 
communication modalities may be employed in methods including, but not limited to, 

10 parallel, serial and simultaneous communication between the contactor 120 and the 

contactee 1 30. By way of illustration, the contactor 120 and the contactee 130 may 
communicate by telephone at the same time that they are sharing a document via 
collaborative editing over a computer network communication modality. 

The contact manager 140 may examine data (e.g., contactor data 150, 

15 modality data 115, contactee data 160) and find information sufficient to perform 

deterministic calculations for identifying the optimal modality for the communication 
110. The deterministic calculations maybe facilitated by applying one or more 
preferences based rules based on the sufficient information. By way of illustration, if 
a first party is attempting to telephone a second party, then the present invention may 

20 display the current best possible means, ranked by likelihood, of reaching the second 

party for real-time telephony given the context of the second party. By way of further 
illustration, if a contactor listed in a contactee's people class store as a "critical 
colleague" tries to reach the contactee, and the contactee is not in a meeting, and it is 
business hours, and the contactee is near a voice-enabled device, and the contactor is 

25 using a voice-enabled device, the present invention may route that contactor to the 

best voice enabled device, unless the contactee is having a conversation with 
someone. 

Tools for displaying and editing such preferences and/or rules would ease the 
task of creating and managing such rules. In a more sophisticated approach, the 
30 present invention directs communications via automated methods that identify 

communication actions that have the value or highest expected value given 
uncertainties in variables under consideration. Several formulations of decision 
problem are feasible, depending on the variables under consideration, the preferences 
being represented, and the principal agent (or "owner") of the decision. 
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In a general formulation of the problem, the present invention considers a 
"communications value function",/; that return a value for each communication 
modality or subset of modalities under consideration or an ordering over 
communication modalities in terms of acceptability of the modality or subset of 
modalities. 

Value(Modality) 

= /(preferences of contactee, preferences of contactor, preferences of 
organization, context of contactee, context of contactor) 

where context of contactee and contactor include the devices that are 
available, the time of day, tasks and situation at hand for the contactor and contactee, 
and the like. It is to be appreciated that the context of the contactee and contactor 
may be stored in one or more formats, including, but not limited to, an XML schema. 
In one example aspect, the present invention orders the modalities by assigned value 
and attempts to create a connection or to advise the contactor and/or contactee 
concerning the best possible connection. 

But the contact manager 140 may discover that incomplete information is 
available. Thus, the contact manager 140 may be uncertain concerning certain data 
points involved in calculations for identifying the optimal modality for the 
communication 110. Thus, the contact manager 140 may be required to reason under 
this uncertainty. For example, in one example aspect of the present invention, the 
contact manager 140 may require a value associated with the attentional state of the 
contactee 1 30. However, for one sample calculation, no such value may be found in 
the contactee data 160. Thus, the contact manager 140 may rely on one or more 
conditional probabilities associated with the contactee 130 attentional status based on 
information like desktop events, ambient noise in the location of the contactee 130 
and gaze tracking when determining the maximum utility. 

In general, there may be uncertainty concerning preferences and one or more 
parameters employed to model a context. In this situation, a probability distribution 
over the different states of each variable can be inferred and expected values for each 
modality can be computed. For example, if there is uncertainty concerning aspects of 
the context of the contactee, the probability distribution (here represented abstractly), 



13 



WO 02/075495 



PCT/US02/07894 



given evidence E observed about the context, and sum over the uncertainties can be 
represented: 

Expected value(Modality) 

= 2/ ^(preferences of contactee, preferences of contactor, preferences of 
organization, ^(context i of contactee|ii), context of contactor) 

The present invention may order the modalities by assigned expected value 
and attempt to create a connection or to advise the contactor and/or contactee 
concerning the best connection. 

Considering now more specific examples of the use of expected utility, a 
particular basic formulation of decision-making under uncertainty in the context of 
the preferences of the contactee 130 is captured by Equation 1 . 

A* = arg max ^ p (context* i \ E) x u(A. ,A%,C, context* z,context c ) (1 ) 

J t 

where A * is the ideal communication actions, which include the modalities employed 
by the contactor (A c *) and contactee (Recipient) (A R *) computed by optimizing 
Equation 1 . In the equation, A } is the communication modality being considered, A c k 
is the communication modality employed by the contactor, context^ is the context of 
the contactee (Recipient) of the intended communication, context c is the context of 
the contactor, and C is the identity of the contactor, typically linked to a class of 
person (e.g., critical associate, previously replied to, family, unknown). Thus, in an 
example aspect of the present invention, the conditional probability p(context R j | E) 
that the contactee has a certain context given the evidence E is employed in 
conjunction with the utility function u to determine the ideal communication actions 
that can be taken to maximize the utility of the communication 1 10 between the 
contactor 120 and the contactee 130. 

The basic formulation for identifying optimal communication modalities can 
be extended by introducing uncertainty about the context of the contactor 120, which 
adds the summing noted in equation 2 to the uncertainty calculations of equation 1. 
The particular communication action and/or modality selected for the initial contact 
by the contactor 120 is represented asA c init , 
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A* = arg max ^ X P( context * * 1 E)p(contoxt c k\E)x u(Aj , A? nh 5 C, context* i, context 0 A:) (2) 

The contactor 120 and contactee 130 contexts represent rich sets of 
5 deterministic or uncertain variables. The contexts may contain data, including but not 

limited to, the available modalities for the contactor 120 and/or contactee 130 (e.g., is 
a private voice channel available, are channel and rich desktop available, are 
television cameras available), information concerning the nature of the location, and 
content or task of the contactor 120 and of the contactee 130. Data associated with 

10 automated assessments and/or directly marked indications of urgency or importance 

in the communications may also be evaluated in identifying optimal communication 
modalities. The contextual variables can be treated as explicit deterministic or 
probabilistic factors in the optimization. For example, m°k can represent the 
modalities available to the contactor 120 and thus equation 3 considers combinations 

15 of modalities available to the contactor 120. 



A* = arg maxYY ^(context* i \ E)p(context c k \ E) 
x u (A(mf , 17%; ), 4° , , C, context* i , context c k) (3) 



Thus, the system 1 00 can, in various example aspects, account for the 
20 preferences, contexts and capabilities of the contactor 120 and/or the contactee 130 

where information concerning the contexts may be incomplete, thus requiring 
reasoning under uncertainty to identify the likely optimal communication modality. 

Referring now to Fig. 2, a system 200 for identifying and establishing optimal 
communications based on the preferences and context of the parties engaged in a 
25 communication 2 1 0 is illustrated. The communication 210 may occur between a 

contactor 220 and a contactee 230. While one communication 210 between one 
contactor 220 and one contactee 230 is illustrated, it is to be appreciated that a greater 
number of communications between a similar or greater number of contactors and/or 
contactees may be identified by the present invention. By way of illustration, 
30 communications 210 to facilitate group meetings may be identified by the system 200 

as can multiple communications 210 between two communicating parties (e.g., 
duplicate messages sent simultaneously by email and pager). 
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The communication 210 that is identified by a communication manager 240 
may depend, at least in part, on one or more sets of data concerning communication 
modalities, contactors and/or contactees, for example. One possible data set, a 
communication modality data set 21 5 concerns the available communication 
5 channels. The available communication channels can include, but are not limited to 

email (of various priorities), telephone (POTS, cellular, satellite, Internet), paging, 
runners/couriers, video conferencing, face-to-face meeting, instantaneous 
collaborative editing, delayed posting collaborative editing, picture in picture 
television, home device activation {e.g., turning on lights in the study, ringing the 

1 0 telephone with a distinctive pattern) and so on. A communication modality may not 

be a static entity, and thus information concerning the state, capacity, availability, cost 
etc., of the communication modalities can change. Thus, the communication modality 
data set 21 5 can contain current state information and/or data to facilitate making 
predictions concerning future state, capacity, availability, cost etc. associated with one 

15 or more communication modalities. 

The location of the contactee 230 can determine which communication 
modalities, if any, are available. For example, a speechwriter may have collaborative 
editing, phone, email, pager, video conferencing and face-to-face communications 
available at her office in the White House, may have phone, face-to-face and email 

20 available while in her office at home, may only have satellite phone available while 

on vacation and may have no real-time capacity while in the shower or asleep. The 
current task of the contactee 230 can also determine which communication modalities, 
if any, are available. For example, if the speechwriter is currently on the phone, then 
the phone may not be available. Predictions concerning the likelihood that the phone 

25 will become available can be employed by the system 200 in determining the optimal 

modality for the communication 210. Thus, rather than sending an email at a first 
point in time {e.g., while the phone is busy), the present invention may schedule a 
real-time phone call at a second, later point in time, when it is likely that the 
speechwriter will be off the phone. 

30 The communication manager 240 may also have available another set of data 

referred to as the contactee data 250. The contactee data 250 may include information 
related to hardware, software, contactee task being performed, contactee attention 
status, contactee context data 252 and contactee preference data 254, for example. By 
way of illustration, the hardware data may include information related to what 
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hardware is available to the contactee, what hardware is being employed by the 
contactee {e.g., desktop, laptop, PDA), the capabilities of that hardware (e.g., enough 
memory and communication bandwidth for videoconferencing), the cost of employing 
that hardware and the state(s) in which that hardware is currently functioning (e.g., 
5 online, offline). The hardware data may also include information concerning usage 

patterns that facilitate determining the likelihood that an unavailable piece of 
hardware will become available. The software data may include information related 
to what software is available to the contactee, what software is currently being 
employed by the contactee (e.g., which word processor is being used to edit the 

10 speech), the capabilities of that software (e.g., allows collaborative editing) and the 

state(s) in which that software is currently functioning (e.g., running and active, 
running but inactive). The software data may also include information concerning 
usage patterns that facilitate determining the likelihood that an unavailable piece of 
software will become available. 

15 The contactee data 250 may also contain preference data 254 concerning the 

preferences of the contactee 230. The preference data 254 can include data 
concerning how the contactee 250 prefers to be contacted, with those preferences 
varying over time with respect to various contactors 220 and various topics of 
communication. For example, the speechwriter may initially allow communications 

20 from a large group of persons concerning the State of the Union speech. The 

speechwriter may also establish preferences that allow the President to communicate 
with her with a best effort at real-time telephony at all times up to the deadline for the 
speech. But the speechwriter may gradually restrict the group of people from whom 
she is willing to accept real-time communications as the deadline approaches and she 

25 may further restrict the means by which such people can communicate. In the last 

hours before the deadline, the speechwriter may be closed to all real-time 
communications except in person communications with the President and telephone 
based emergency medical information concerning family members, for example. 

The contactee preference data 254 can include data concerning, but not limited 

30 to, preferences concerning the time of day for communicating (e.g., early morning, 

business hours, evening, late night, sleeping hours), the time of the week for 
communicating (e.g., Monday through Friday, Weekend, Holiday, Vacation), identity 
of contactors (e.g., employer, employees, critical colleague, colleague, peers, nuclear 
family, extended family, close friends, friends, acquaintances, others), hardware 
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currently available or available within a time horizon of a communication attempt 
(e.g., desktop, laptop, home computer), preferred software (e.g., email, word 
processing, calendaring ) and preferred interruptability (e.g., do not interrupt while 
focused on work, only interrupt while not focused), for example. While six 
5 preferences are identified in the preceding sentence, it is to be appreciated that a 

greater or lesser number of preferences may employed in accordance with the present 
invention. 

The contactee data 250 may also include a context data 252. The context data 
252 is generally related to observations about the contactee 230. For example, 

1 0 observations concerning the type of activity in which the contactee 230 is involved 

(e.g., on task, not on task), location of the contactee 230 (e.g., office, home, car, 
shower), calendar (e.g., appointment status, appointment availability), history of 
communications with other party (e.g., have replied to email in the past, have spoken 
to on the telephone recently, the utility of the interaction, the duration of the 

15 interaction), background ambient noise at current location, number of hours at work 

that day and attentional status (e.g., high focus, focus, light focus, conversation with 
another person, light activity) may be stored in the context data 252. While seven 
observations are listed in the preceding sentence it is to be appreciated that a greater 
or lesser number of observations may be stored in the context data 252. On some 

20 occasions the context data 252 may be incomplete (e.g., video analysis data 

unavailable because video camera broken). Thus, the communication manager 240 
may need to reason concerning the optimal communication while relying on such 
incomplete data. Thus, the contactee data 250 may also include information to 
facilitate producing one or more probabilities associated with a missing data element. 

25 By way of illustration, the contactee data 250 may contain information operable to 

predict the likelihood that the contactee 230 is in a high attentional state even though 
gaze tracking information is unavailable. 

The contactee data 250 may further include information concerning the long- 
term and/or acute, dynamically changing communication needs of the contactee 250. 

30 By way of illustration, the contactee 250 may need to have no interruptions for the 

next hour (e.g., "hold everything unless high critical on this task or an hour from 
now"). By way of further illustration, to prevent a contactor 220 from "ducking" the 
contactee 230 by leaving an email or a voice mail when the contactee 230 desires to 
speak with the contactor 220, the contactee 230 may require that contacts from the 
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contactor 220 be made in a certain way within X units of time of notification that the 
contactor 220 desires communication (e.g., if research assistant tasked with finding a 
crucial fact tries to contact speechwriter by email, speechwriter wants real-time phone 
conversation within ten seconds of assistant's attempt). 
5 Thus, returning to equation 1, 

A* = argmax ^ /?(context* i \ E)x u^A^A^C, context* /,context c ) (1) 

the contactee data 250 is seen to contribute to the utility function u through the 
context 1 ^ component, which can include the contactee context data 252 discussed 
above. 

10 In addition to the contactee data 250 employed in determining the optimal 

communication, data concerning the contactor 220 may also be employed. The 
contactor data 260 may include hardware, software, context, preference and 
communication needs data similar to that available for the contactee 230, but different 
in that it is prepared from the point of view of the contactor 220. 

1 5 Thus, returning again to equation 1 , 

A* = argmax V ^(context* i\E)x u(A ,A£ 9 C, context* /,context c ) (1) 

the contactor data 260 is seen to contribute to the utility function u through the 
context 0 component, which can include the contactor context data 262 discussed 
above. 

20 The present invention is not limited to communications between two parties or 

to a single communication channel between two parties. It is to be appreciated that 
multiple channels and/or multiple communicating parties can be treated as increased 
sets of alternatives that may complicate utility maximizing computations without 
changing the fundamental process of identifying and establishing one or more 

25 communication modalities based on the preferences, contexts and capabilities of the 

communicating parties. 

The communication manager 240 may include several components responsible 
for performing portions of the functionality of the communication manager 240. For 
example, the communication manager may include a preference resolver 242. The 

30 preference resolver 242 can examine the contactee preference data 254 and the 
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contactor preference data 264 to find correlations between the two sets of data. For 
group communications, the preference resolver 242 may examine multiple sets of 
preference data to find correlations between the preferences. By way of illustration, 
for a communication between two parties, the preference resolver 242 may determine 
5 that both parties would prefer to communicate by high priority email for 

communications associated with a first task. Similarly, the preference resolver 242 
may determine that the contactee 230 would prefer to communicate by collaborative 
editing and phone for communications concerning a particular document, while the 
contactor 220 would prefer to communicate only by telephone. Thus, the preference 

1 0 resolver 242 may produce data or initiate processing that assigns values to the 

correlations between the contactee 230 preferences and the contactor preferences 220. 
In one example aspect of the present invention, the preferences of the contactee 230 
are given more weight, and thus, if the contactor 220 attempted a phone conversation 
concerning the document for which the contactee 230 preferred both phone and 

1 5 collaborative editing, then the preference resolver 242 may produce data or initiate 

processing that would make it more likely that the contactor 220 would communicate 
by both phone and collaborative editing. In another example aspect of the present 
invention, the preferences of the contactor 220 are given priority over the preferences 
of the contactee. By way of illustration, when a human contactor 220 is attempting to 

20 communicate with an electronic contactee 230, the preferences of the contactor 220 

may be considered more important, and thus the preference resolver 242 may produce 
values or initiate processing that makes it more likely that the preferences of the 
contactor 220 are observed. In another example aspect of the present invention, the 
preference resolver 242 may produce a list of potential communication modalities 

25 ranked on their responsiveness to the preferences. 

The communication manager 240 may also include a context analyzer 244. 
The context analyzer 244 can examine the contactee context data 252 and the 
contactor context data 262 to find correlations between the two sets of data. For 
group communications, the context analyzer 244 may examine multiple sets of 

30 context data to extract information concerning the contexts. By way of illustration, 

for a communication between two parties, the context analyzer 244 may determine 
that the contactee context is such that real-time communications are not immediately 
available but there is an Xi% likelihood that such communications will be available at 
a point of time Ti in the future, and an X 2 % likelihood that such communications will 
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be available at a point of time T 2 in the future. Further, the context analyzer 244 may 
determine that although the contactor 220 has requested real-time telephony that the 
context of the contactor 220 is such that email communication may optimize utility. 
For example, the context of the contactor 220 may include information concerning the 
ambient noise at the location of the contactor 220. The context analyzer 244 may 
determine that the noise level is not conducive to optimizing utility by real-time 
telephony and thus may produce values and/or initiate processing that will make it 
more likely that the contactor 220 will communicate with the contactee 230 via email. 
Similar to processing performed by the preference resolver 242, the context analyzer 
may, in different examples of the system 200, weight the context of the contactee 230 
more than the context of the contactor 220 or vice versa. 
Returning again to equation 1, 

A* = arg max ^ /?(context* i \ E)x u(A J9 A^C 9 context* z,context c ) (1) 

in one example of the present invention, the context analyzer 244 can be 
viewed as performing processing associated with the utility function u and its analysis 
of the context^ and the context 0 . 

The communication manager 240 may also include a channel analyzer 246. 
The channel analyzer 246 can be employed to analyze the communication modality 
data set 215, for example. The channel analyzer 246 can produce data concerning the 
current availability of a communication modality and/or the likelihood of the modality 
becoming available. The channel analyzer 246 may examine one or more channels 
that the contactor 220 specified for the communication, and/or one or more channels 
that the contactee 230 listed as preferences in the contactee preference data 254, for 
example. Further, the channel analyzer 246 may examine currently available 
channels as determined by location information associated with the contactee 230 and 
channels that may become available based on the activity of the contactee 230. For 
example, if the contactee 230 is currently driving home (as determined by GPS and 
schedule, for example), then the channel analyzer 246 may examine current cellular 
modalities and may additionally examine the modalities available at the home of the 
contactee 210. Thus, the channel analyzer 246 facilitates producing data and/or 
initiating processing that make it more likely that a desired channel will be employed 
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when determining the optimal communication channel(s) for the communication 210 
between the contactor 220 and the contactee 230. Thus, examining equation 1 , 

A* = argmax^ jr?(context* i\E)x u(A J9 Aj; 9 C 9 context* *,context c ) (1) 

in one example of the present invention, the channel analyzer 246 can be 
viewed as performing processing associated with the utility function u and its analysis 
of the contactor modalities Aj and the contactee modalities A C k- 

The communication manager 240 may also include a communication 
establisher 248. Once the ideal communication actions A* have been identified, the 
communication establisher 248 may undertake processing to connect the contactor 
220 and the contactee 230 through the identified optimal communication modality. 
For example, if the optimal communication 210 is identified as being email, then the 
communication establisher may initiate an email composing process for the contactor 
220 {e.g., email screen on computer, voice to email converter on cell phone, email 
composer on two-way digital pager), and forward the composed email to the most 
appropriate email application for the contactee 230 based on the identified optimal 
communication 210. For example, the communication establisher 240 may forward 
the email to the pager of the contactee 230 based on GPS data associated with the 
location of the contactee 230. In an alternative embodiment of the present invention, 
the system 200 does not include a communication establisher 248, relying instead on 
contactor 220 and/or contactee 230 actions, for example, to establish the 
communication. 

It is to be appreciated that the preference resolver 242, the context analyzer 
244, the channel analyzer 246 and the communication establisher 248 may be 
implemented alone or in combinations of hardware, software and/or firmware. It is to 
be further appreciated that the preference resolver 242, the context analyzer 244, the 
channel analyzer 246 and the communication establisher 248 may employ one or 
more threads and/or processes executing alone and/or co-operating. Further, such 
threads and/or processes may reside on one processor and/or may be distributed over 
two or more processors. In one example of the present invention, the preference 
resolver 242, the context analyzer 244, the channel analyzer 246 and the 
communication establisher 248 are separate processes employing one or more threads, 
with each of the separate processes residing in one processor. 
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Fig. 3 illustrates a system 300 for identifying and establishing an optimal 
communication based on the preferences, capabilities and contexts of the parties to 
engage in the communication, wherein components previously described with respect 
to Fig. 2 are identified in Fig. 3 by similar reference numbers which have been 
increased by adding 1 00. The system 300 includes a communication choices data 
store 370 and an invoking component 380. The communication choices data store 
370 can store data in data structures including, but not limited to one or more lists, 
arrays, tables, databases, stacks, heaps, linked lists and data cubes. The 
communication choices data store 370 can reside on one logical and/or physical 
device and/or may be distributed between two or more logical and/or physical devices 
(e.g., disk drives, tape drives, memory units). The communication choices data store 
370 can store information produced and/or retrieved, for example, by the 
communication manager 340 concerning potential modalities that can be employed to 
facilitate the communication 310. For example, the communication choices data store 
370 can hold lists of communication modality rankings that can be presented to the 
contactor 320 and/or contactee 330, which will then allow the communicating parties 
to enter into a dialog with the system 300 and/or each other to decide which of the 
available choices they would prefer for this particular communication. The dialog 
may produce entity selection data concerning the communication, where such data 
can be employed to choose between possible communication modalities. Similarly, 
the communication choices data store 370 can hold lists of communication modality 
rankings that can be presented to the invoking component 380. The invoking 
component 380 may then attempt to establish the identified communications. Due to 
race conditions, for example, the invoking component 380 may attempt to establish a 
communication that is no longer possible (e.g., phone was available then becomes 
unavailable), and thus, the invoking component 380 may work through the list 
available in the communication choices data store 370 until a communication is 
established. 

The invoking component 380 may perform actions including, but not limited 
to, scheduling, calendaring and/or initiating a communication. By way of illustration, 
the invoking component 380 may determine, based at least in part on data stored in 
the communication choices data store 370, that a real-time communication should be 
performed in ten minutes. Thu t s, rather than immediately initiate the communication, 
the invoking component 380 may schedule the communication and may inform the 
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parties who are going to communicate that the communication has been scheduled. 
By way of further illustration, the invoking component 380 may determine that a 
video-conference between four parties should be performed and by examining the 
calendars of the four individuals, the invoking component 380 may determine that the 
video conference should occur at four o'clock in the afternoon on May 1 st . Thus, the 
invoking component 380 may update the calendars of the parties, arrange for the 
video-conference, and inform the parties of the plans. By way of still further 
illustration, the invoking component 380 may determine that both parties are 
immediately available for the real-time communication and may dial the phones on 
both ends to establish the communication. 

Fig. 4 illustrates an environment 400 in which the present invention may be 
employed. The environment 400 may include a plurality of communication devices, 
some of which are available to one or more contactors and some of which are 
available to one or more contactees. For example, the left side of Fig. 4 may 
represent communication devices associated with a contactor and the right side of Fig. 
4 may represent communication devices associated with a contactee. The contactor 
may have, for example, a phone 405, a laptop 410, a desktop system 415, a fax 420, a 
courier 425 and a home television 430 available at different times and at different 
locations. The contactee may have, for example, a phone 450, a laptop 455, a regular 
mail reader 460, a minicomputer system 470, a mainframe system 475 and a home 
television 480 available at different times and at different locations. 

The contactee may have established preferences that indicate that for 
communications from a first group of contactors {e.g., traveling salesmen employees 
of the contactee) the contactee would prefer email, and if the contactor does not have 
email capability, then the contactee would prefer regular mail, and would only prefer 
a real-time communication if no other modality was available and the communication 
was high critical. Similarly, the contactee may have established preferences that 
indicate that for communications from a second group of contactors (e.g., nuclear 
family, close friends) the contactee would prefer real-time phone communications 
concerning a first group of topics (e.g., work-related, emergency medical information 
related), and would prefer an email concerning other groups of topics. By way of 
further illustration, the contactee may have established preferences that indicate that 
for communications from a third group of contactors (e.g., collaborating authors) that 
the contactee would prefer both a real-time phone call and a shared computer screen 
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displaying the document at a point concerning which the contactor wishes to 
communicate. 

Given this set of preferences, communications attempted from a contactor may 
take a different form than the contactor would prefer. But since the attention of the 
5 contactee is the resource that is heing accessed, for certain groups that resource will 

be sparely provided, while for other groups it will be generously provided, depending 
on the preferences of the contactee and the identity of the contactor. 

The preferences of the contactee are not the only data points that are evaluated 
by the present invention when identifying the optimal communication modality for 

1 0 establishing a communication between the contactor and the contactee. For example, 

although the contactee may prefer an email or a regular piece of mail from a traveling 
salesman concerning a contract the salesman has written {e.g., for documentary 
purposes), the salesman may not have a computer operable to send email and may not 
have time to send a regular piece of mail. Thus, the salesman who desires to contact 

1 5 the contactee may be informed by the present invention, after it analyzes the 

preferences and the capabilities of the parties, to send a fax using the fax machine 
420. The present invention may then route the fax to the regular mail reading 
component 460 that can produce a communication close to what the contactee 
desired, thereby maximizing the utility of the communication while taking into 

20 account both the preferences and capabilities of the parties. 

The preferences of the contactee may depend on where the contactee is 
located. Similarly, the capabilities of the contactee may depend on where the 
contactee is located. By way of illustration, at the office, the contactee may have a 
phone 450, the minicomputer 470 and the mainframe system 470 available. But at 

25 home the contactee may have only a phone 450, a laptop 455 and a television 480. 

Furthermore, while on the road, the contactee may have only the laptop 455. Thus, 
the present invention is able to examine the context of the contactee, which includes 
the location of the contactee, to determine capabilities. Even within a location, the 
capabilities of the contactee can vary from time to time. For example, at certain times 

30 during the day at work, the ambient noise level may be so high that real-time 

communications are impractical, and little, if any information could be communicated 
(e.g., while a particularly noisy piece of equipment is running near the telephone of 
the contactee). Thus, if a contactor attempts to contact the contactee employing real- 
time telephony, the present invention may schedule the phone call for a few minutes 
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after the noisy equipment typically spins down, or may take a voice mail that is 
converted to email and displayed on the contactee's pager, for example. In this way, 
the present invention seeks to maximize the utility of the communication given the 
contactee's preferences and the contactee's capabilities, as those preferences and 
5 capabilities are affected by the dynamic environment in which the contactee exists. 

The television 430 and the television 480 are examples of home devices that 
may be employed by the present invention to maximize the utility of a 
communication. For example, if the contactee's security company is faying to alert 
the contactee to an important piece of information (e.g., a theft in progress at the 

1 0 plant), and the contactee is at home watching a movie, then the present invention 

facilitates the contactor reaching the contactee by real-time phone communication and 
simultaneous video streamed to the contactee's television. Thus, the utility of the 
communication may be maximized as the contactee may be able to identify the thief 
or inform the security company that the apparent break-in is really a scheduled late- 

15 night pick-up. 

Thus, it is to be appreciated that devices {e.g., televisions, telephones, heating 
systems, air filtration systems, etc.) may employ the present invention. By way of 
illustration, the contactor may be the local electric company computer, and the 
contactee may be a factory heating and air filtration system. The contactor may seek 

20 to inform the heating and filtration system, by the best means possible, that a rolling 

brownout is going to impact the plant in approximately thirty minutes. Thus, the 
present invention may attempt, based on the preferences and capabilities of the 
heating and filtration system and the preferences and capabilities of the electric 
company computer to communicate information concerning the length, duration and 

25 severity of the impending brownout. Thus, the factory may be able to act proactively, 

rather than reactively, to the brownout. This example is intended to illustrate that the 
present invention may be employed between computer processes. If the present 
invention informs the electric company computer that no communication is possible 
with the plant heating and filtration system, but that communication with the plant 

30 manager is possible via real-time telephony, then the electric company computer may 

place such a call. This escalation example is intended to illustrate that the present 
invention may be employed between computer processes and humans. 

One example aspect of the present invention provides initiating means (e.g., 
button, icon, voice command) that can be employed to initiate identifying and 

26 



WO 02/075495 



PCT/US02/07894 



establishing communications. The initiating means may, for example, be a button 
labeled BestCom, an icon with a star surrounding a data communication link or a 
voice command "Best Com Please". When the initiating means are employed, the 
context of the contactor is considered to be deterministic, and the context of the 
5 contactee is considered to be uncertain. Such may be the case where there is a 

relatively small amount of deterministic information available from the contactor, but 
rich, sensed context information available for the contactee. By way of illustration, 
the laptop 410 may include an icon that signifies that the contactor desires the 
attempted communication to employ the present invention. Thus, in this example of 

10 the present invention, the context of the contactor would be considered deterministic 

and the context of the contactee would be considered uncertain, triggering processing 
associated with reasoning under uncertainty. 

Fig. 4 presents several communication devices that may be employed in 
establishing an optimal communication between a contactor and a contactee. For 

1 5 example, the present invention may determine that a real-time telephony 

communication between the contactor employing telephone 405 and the contactee 
employing telephone 450 may optimize the utility of the communication between the 
parties. But communicating through the telephones may not be possible at the 
moment that the contactor desires to make contact. Thus, the present invention can 

20 also consider the likelihood of obtaining access to a modality within a time frame /, 

where the likelihood that modalities could be made available by time t is represented 
by p(m c it(t)\E). Another aspect of the present invention includes considering the costs 
to the contactor and/or contactee of arranging to access modalities that might not be 
available immediately. Thus, the opportunity to establish a communication with a 

25 first expected utility that is available immediately may be foregone for the opportunity 

to establish a communication with a second, higher expected utility at a later point in 
time. 

In view of the exemplary systems shown and described above, methodologies, 
which may be implemented in accordance with the present invention will be better 
30 appreciated with reference to the flow diagrams of Figs. 5 and 6. While for purposes 

of simplicity of explanation, the illustrated methodologies are shown and described as 
a series of blocks, it is to be understood and appreciated that the present invention is 
not limited by the order of the blocks, as some blocks may, in accordance with the 
present invention, occur in different orders and/or concurrently with other blocks from 
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that shown and described herein. Moreover, not all illustrated blocks may be required 
to implement a methodology in accordance with the present invention. Further, 
additional and/or alternative methodologies may employ additional blocks, not 
illustrated herein. 

Turning now to Fig. 5, a flow chart illustrates a method 500 for identifying 
and establishing an optimal communication modality between two or more 
communicating parties. The method 500 addresses determining maximum utility for 
a communication in a deterministic situation. At 5 1 0, general initializations occur. 
Such initializations can include, but are not limited to, allocating memory, 
establishing pointers, establishing data communications, acquiring resources, setting 
variables and displaying process activity. 

At 520, data including, but not limited to, contactor data, contactee data and 
communication modality data is analyzed. The contactor data can include, but is not 
limited to, situation data and contactor preference data. The situation data can include 
observed data, for example, data gathered by watching the contactor and or observing 
the contactor's environment. For example, ambient noise levels may be analyzed to 
determine whether voice communications are practical. The contactor situation data 
can include, but is not limited to contactor application data {e.g., which applications 
are being employed), contactor user data (e.g., who is using the application) and 
contactor capability data. The contactor preference data refers to how the contactor 
would like the communication to be achieved. The contactor preference data 
includes, but is not limited to time data, location data, task data, goal data and 
communication needs data. In addition to the contactor and contactee preference data, 
there may be organization preference data. For example, when both a contactor and 
contactee belong to the same organization, then the contactor preferences and the 
contactor preferences may be blended together in accordance with organization 
policies. The communication needs data may, for example, include information that 
the contactor must contact the specified contactee within a specified period of time 
(e.g., investor must reach broker before the stock market closes). The contactee data 
includes, but is not limited to contactee situation data and contactee preference data. 
The contactee situation data can include but is not limited to contactee application 
data, contactee user data and contactee capability data. The contactee preference data 
includes but is not limited to time data, location data, task data, goal data and 
communication needs data. 
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The contactor data, the contactee data and the modality data may include 
information describing current conditions and information that facilitates predicting 
future conditions. For example, a phone may currently be in use, but data concerning 
phone usage patterns may be analyzed to facilitate determining the likelihood that that 
5 phone will be available at a point of time in the future. 

The analysis of 520 can model utilities that consider the relationships between 
contactor and contactee preferences. For example, if both parties prefer real-time 
telephone communications, then there may be a high utility to arranging real-time 
telephony, but if one party prefers email and another party prefers video- 

10 conferencing, then real-time communications may not be preferred. In addition to 

blending the contactor preference data with the contactee preference data, there may 
be blending with organization preference data. For example, when both a contactor 
and contactee belong to the same organization, then the contactor preferences and the 
contactor preferences may be blended together in accordance with organization 

1 5 policies. The best communication actions may also be influenced by the capabilities 

of communication devices available at the time the communication is attempted 
and/or at some future time by the contactor and contactee. For example, if the 
contactor has video conferencing equipment available and the contactee similarly has 
video conferencing equipment available, then video conferencing may receive a high 

20 value in the analysis of preferences. But if the contactor has email capability, and the 

contactee has only regular mail capability, then video conferencing maybe untenable 
even if it would have been the most desirable feature. In such a case, if the cost (e.g., 
delay time, effort, and/or dollars) of one of the participants finding a video 
conferencing facility is lower than the cost of moving to the next best modality, then it 

25 may be optimal to delay the communication until the initially deficient participant 

locates and executes communication with tools allowing for such rich 
communication. 

At 530, one or more rules maybe selected from a set of possible rules, where 
the rules can be employed to determine expected utilities. For example, given a large 
30 set of communication modalities and/or preferences, a first set of rules may be 

selected but given a small set of communication modalities and/or preferences, a 
second set of rules may be selected. The rules may be selected on other parameters 
including, but not limited to, the number of matching preferences, the number of 
matching capabilities, the nature and quality of the contexts, the type and number of 
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communications requested and the time critical nature of the desired communication. 
The rules may have been specified by the contactee, for example. By way of 
illustration, contactees can specify groups of people and attributes concerning the 
nature of the contact and rules for communicating given the context (e.g., time, task, 
5 goals, location, contactor). 

At 540, the rules selected at 530 are employed to determine one or more 
expected utilities for the candidate communication modalities. By determining a set 
of expected utilities, that include both immediately available modalities and 
modalities predicted to be available at a point of time in the future, the present 

1 0 invention facilitates optimizing the utility of the communication, thus providing 

improvements over conventional systems. 

At 550, information concerning the possible communication modalities and 
their expected utilities can be presented to a contactor and/or contactee. Thus, the 
contactor and/or contactee can select from the possible communications that are 

1 5 identified as maximizing the utility of the communication. For example, a contactor 

may want to place a real-time telephone call, but may be presented with a list of other 
communication modalities that may produce higher utilities (e.g., high priority page to 
a person in a meeting where there is no telephone, real-time telephone call to 
contactee's assistant). Similarly, the contactee may be informed that the contactor is 

20 trying to contact them, and the contactee may be given the opportunity to override 

their preferences based on their current capabilities. By way of illustration, the 
contactee may be at home watching a movie at two a.m. when the preferences indicate 
that no real-time phone communications are desired. Since the present invention 
determined that the contactee was immediately reachable, the contactee may be 

25 presented, on the television, with a list of options for being contacted by the contactor 

(e.g., phone call, email, streaming video) and may be given the opportunity to 
override the preferences (e.g., willing to accept a phone call from the police 
department). 

At 560, once the optimal communication modality or modalities have been 
30 identified, by the method and/or by the contactor and/or contactee, then the 

communication can be scheduled, calendared and/or initiated. By way of illustration, 
a real-time phone call, with both parties immediately capable and available can be 
initiated by ringing the phones, a collaborative editing session, with simultaneous 
instant messaging and cell phone communication may be scheduled for later in the 
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day with email reminders sent to both parties and a video conference may be 
calendared for May 1 st at four o'clock in the afternoon, with calendar updates made 
for all invited parties. 

At 570 a determination is made concerning whether another communication is 
5 desired. If the determination at 570 is no, then processing concludes, otherwise 

processing continues at 520. 

The method 500 is not limited to one on one communications. Groups may be 
linked together using method 500 by analyzing data {e.g., hardware, software, 
context, preferences) of more than two communicators. By way of illustration, one or 

10 more participants may attempt to establish a communication between six people. The 

method 500 may determine that four people are ready, willing and able to 
communicate via a videoconference, while two others may only communicate with 
email (one due to preferences and one due to lack of a video camera). The method 
500 may, therefore, alert the user with the email preference concerning overriding the 

15 preferences for this particular real-time communication, and may connect the person 

without a camera by voice only, while alerting the camera enabled group that this 
member cannot see them and can only hear them. 

Turning now to Fig. 6, a flow chart illustrates a method 600 for identifying 
and establishing an optimal communication between two or more communicating 

20 parties. The method 600 addresses reasoning under uncertainty concerning one or 

more data points employed in determining a maximum utility for a communication. 
At 610, general initializations occur. Such initializations can include, but are not 
limited to, allocating memory, establishing pointers, establishing data 
communications, acquiring resources, setting variables and displaying process 

25 activity. 

At 620, data including, but not limited to, contactor data, contactee data and 
communication modality data is analyzed to determine correlations that can be made 
and inferences that need to be made. The contactor data, which may be incomplete, 
can include, but is not limited to, situation data and contactor preference data. The 
30 situation data, which can also be incomplete, can include data gathered by watching 

the contactor and or observing the contactor's environment. For example, light levels 
may be analyzed to determine whether textual communications are practical. But 
there may be gaps in the contactor situation data. For example, information 
concerning the light level of the contactor may not be available, and thus inferences 
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concerning such light may be required to be made from data like the location of the 
contactor {e.g., in a darkroom, in a truck) and the time of day {e.g., during daylight 
hours, late at night). 

The contactee data, which may similarly be incomplete, includes, but is not 
5 limited to contactee situation data and contactee preference data. The contactee 

situation data, which is analogous to the contactor situation data, except that it is 
gathered from the point of view of the contactee, can similarly be incomplete and may 
include, but is not limited to contactee application data, contactee user data and 
contactee capability data. By way of illustration, data concerning the contactee 's 

1 0 attentional state may be observed by monitoring data like gaze tracking data and 

desktop events {e.g., keyboard strikes, mouse movements). Such observed data may 
be combined to produce a likelihood that the contactee is in a certain attentional state 
{e.g., focused, not focused). Such a likelihood may then be combined with 
information concerning the assignment of the contactee and the current task being 

1 5 performed by the contactee to determine a value associated with the interruptability of 

the contactee. By way of illustration, if the contactee is focused on a task that is 
related to the contactee's assignment, then the contactee interruptability value maybe 
very low while if the contactee is not focused and is not performing a task related to 
the contactee 5 s assignment, then the contactee interruptability value may be very high. 

20 Calculating such an interruptability parameter may be a step in determining the 

optimal communication modality. But if a piece of data employed in calculating such 
interruptability is missing, then the present invention may make inferences concerning 
the missing data point so that likely optimal communications can be calculated. 
The contactor data, the contactee data and the modality data may include 

25 information describing current conditions and information that facilitates predicting 

future conditions. For example, a phone may currently be in use, but data concerning 
phone usage patterns may be analyzed to facilitate determining the likelihood that that 
phone will be available at a point of time in the future. 

Thus, at 630, selected inferences may be made. For example, p(context R i | E) 

30 may be inferred to produce the conditional probability that a recipient (contactee) has 

a given context given certain evidence E. Similarly, an inference concerning the 
likelihood of obtaining access to a modality within a time frame t y where the 
likelihood that modalities could be made available by t time is represented by 
p(m r k {t)\E) can be made. 



WO 02/075495 



PCT/US02/07894 



At 640, values associated with the inferences of 630 can be analyzed to 
determine one or more values that maybe employed in inference formulae that are 
employed to determine a communication with a maximum utility. The inference 
formulae may be, for example, decision-theoretic formulae. 

At 650, inference formulae may be employed to determine the maximum 
utility for a communication. In one example aspect of the present invention, a basic 
decision-theoretic formula employed in decision-making under uncertainty in the 
context of a contactee is: 

A* = arg max ]T ^(context* i | E) x u(Aj , A% , C, context* z,context c ) (1) 

j i 

where A * is the ideal communication actions, which include the modalities 
employed by the contactor (A c *) and contactee (Recipient) (A R *) computed by 
optimizing Equation 1 . In the equation, Aj is the communication modality being 
considered, A c k is the communication modality employed by the contactor, context*/ 
is the context of the contactee (Recipient) of the intended communication, context 0 is 
the context of the contactor, and C is the identity of the contactor, typically linked to a 
class of person {e.g., critical associate, previously replied to, family, unknown). 

The basic formulation for identifying optimal communication modalities can 
be extended by introducing uncertainty about the contactor's context, which adds 
summing over the additional uncertainty to equation 1. 

A* = arg max ^ ]jT /?(context* i | i?)p(context c k\E)x u(A j:> Af nit ,C, context* /, context 0 k) (2) 

3 i k 

Variables associated with contactor and/or contactee contexts can be treated as 
explicit deterministic or probabilistic factors in optimization processing associated 
with identifying the optimal communication modality. Thus, in equation 3, m°k 
represents the modalities available to the contactor and thus equation 3 considers 
combinations of such modalities. 

A* = arg max Y Y ^(context* i | £)/?(context c k \ E) 

*>» ik 

x u {A{mf y m^\A^ nin C, context* i, context 0 fc) (3) 
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The present invention may further compare the best option for communication 
available now with the best communication option that will be available later, and 
update the value of the communication for the losses based in delays in 
communication, and potential gains or losses based on changes in disruptiveness if the 
5 communication should come at the later time t when the contactee is in a different 

state {e.g., more available or less available). 

Value A * \tj - ValueA * (/ 0 ) = 

max ]T /?(context* i \ E,t + )p(contQxt c k \ E,tJ 

x u(A(mf (OX(OX4*»> c > context* z*(0> context c k(t + )) 
max V y] ^(context* i \ E, £ 0 )/?(context c k \ E, t 0 ) 

x k 

x u(A(mf (t Q ),mC(t o y),A£ it9 C 9 context* i(t Q ) 9 context 0 k(t Q )) 

(4) 

The present invention also facilitates considering the value of delaying the 
10 communication and rescheduling it for a later time. As an example, assume that a 

contactor attempts to contact a contactee in real-time and the contactee is in an 
important meeting. The best option (e.g., one that maximizes utility) may be to 
reschedule a real-time conversation when the contactee is back from meeting, based 
on the calendar information or on statistics about the contactee's coming and going 
1 5 that facilitate predicting the contactee's likely availability. One aspect of the present 

invention may also consider the calendar of the contactor to arrange a mutually good 
time. 

Thus, decision-theoretic formulae like those described in equations 1 through 
4 may be employed at 650 to produce one or more expected utilities. In one example 

20 aspect of the present invention, a communication would automatically be initiated, 

scheduled and/or calendared based on such information. But in another aspect of the 
present invention, information concerning those expected utilities maybe presented to 
one or more parties, as at 660. By way of illustration, a contactor may be presented 
with a list of communications with high utilities determined in accordance with the 

25 preferences of the contactee. The contactor may then select from the list. 

Based, at least in part on the selection of 660, one or more communications 
maybe initiated (e.g., phones dialed, email composer/receiver popped up), scheduled 
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and/or calendared at 670. At 680 a determination is made concerning whether another 
communication is to be processed. If the determination at 680 is YES, then 
processing continues at 620, otherwise processing concludes. 

In order to provide additional context for various aspects of the present 
5 invention, Fig. 7 and the following discussion are intended to provide a brief, general 

description of a suitable computing environment 710 in which the various aspects of 
the present invention may be implemented. While the invention has been described 
above in the general context of computer-executable instructions that may run on one 
or more computers, those skilled in the art will recognize that the invention also may 

10 be implemented in combination with other program modules and/or as a combination 

of hardware and software. Generally, program modules include routines, programs, 
components, data structures, etc. that perform particular tasks or implement particular 
abstract data types. Moreover, those skilled in the art will appreciate that the 
inventive methods may be practiced with other computer system configurations, 

15 including single-processor or multiprocessor computer systems, minicomputers, 

mainframe computers, as well as personal computers, hand-held computing devices, 
. microprocessor-based or programmable consumer electronics, and the like, each of 
which may be operatively coupled to one or more associated devices. The illustrated 
aspects of the invention may also be practiced in distributed computing environments 

20 where certain tasks are performed by remote processing devices that are linked 

through a communications network. In a distributed computing environment, 
program modules may be located in both local and remote memory storage devices. 

With reference to Fig. 7, an exemplary environment 710 for implementing 
various aspects of the invention includes a computer 712, the computer 712 including 

25 a processing unit 7 1 4, a system memory 716 and a system bus 718. The system bus 

718 couples system components including, but not limited to the system memory 716 
to the processing unit 714. The processing unit 714 may be any of various 
commercially available processors. Dual microprocessors and other multi-processor 
architectures also can be employed as the processing unit 714. 

30 The system bus 718 can be any of several types of bus structure including a 

memory bus or memory controller, a peripheral bus and a local bus using any of a 
variety of commercially available bus architectures. The system memory 722 
includes read only memory (ROM) 720 and random access memory (RAM) 722. A 
basic input/output system (BIOS), containing the basic routines that help to transfer 
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information between elements within the computer 712, such as during start-up, is 
stored in ROM 720. 

The computer 712 further includes a hard disk drive 724, a magnetic disk 
drive 726, (e.g., to read from or write to a removable disk 728) and an optical disk 
5 drive 730, (e.g., for reading a CD-ROM disk 732 or to read from or write to other 

optical media). The hard disk drive 724, magnetic disk drive 726 and optical disk 
drive 730 can be connected to the system bus 718 by a hard disk drive interface 734, a 
magnetic disk drive interface 736 and an optical drive interface 738, respectively. 
The drives and their associated computer-readable media provide nonvolatile storage 

10 of data, data structures, computer-executable instructions, etc. for the computer 712, 

including for the storage of broadcast programming in a suitable digital format. 
Although the description of computer-readable media above refers to a hard disk, a 
removable magnetic disk and a CD, it should be appreciated by those skilled in the art 
that other types of media which are readable by a computer, such as zip drives, 

15 magnetic cassettes, flash memory cards, digital video disks, cartridges, and the like, 

may also be used in the exemplary operating environment, and further that any such 
media may contain computer-executable instructions for performing the methods of 
the present invention. 

A number of program modules can be stored in the drives and RAM 722, 

20 including an operating system 740, one or more application programs 742, other 

program modules 744 and program data 746. It is to be appreciated that the present 
invention can be implemented with various commercially available operating systems 
or combinations of operating systems. 

A user can enter commands and information into the computer 712 through a 

25 keyboard 748 and a pointing device, such as a mouse 750. Other input devices (not 

shown) may include a microphone, an IR remote control, a joystick, a game pad, a 
satellite dish, a scanner, or the like. These and other input devices are often connected 
to the processing unit 714 through a serial port interface 752 that is coupled to the 
system bus 718, but may be connected by other interfaces, such as a parallel port, a 

30 game port, a universal serial bus ("USB"), an IR interface, etc. A monitor 754 or 

other type of display device is also connected to the system bus 718 via an interface, 
such as a video adapter 756. In addition to the monitor, a computer typically includes 
other peripheral output devices (not shown), such as speakers, printers etc. 

36 



WO 02/075495 



PCT/US02/07894 



The computer 712 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer(s) 758. The 
remote computer(s) 758 may be a workstation, a server computer, a router, a personal 
computer, microprocessor based entertainment appliance, a peer device or other 
5 common network node, and typically includes many or all of the elements described 

relative to the computer 712, although, for purposes of brevity, only a memory storage 
device 760 is illustrated. The logical connections depicted include a local area 
network (LAN) 762 and a wide area network (WAN) 764. Such networking 
environments are commonplace in offices, enterprise- wide computer networks, 

10 intranets and the Internet. 

When used in a LAN networking environment, the computer 712 is connected 
to the local network 762 through a network interface or adapter 766. When used in a 
WAN networking environment, the computer 712 typically includes a modem 768, or 
is connected to a communications server on the LAN, or has other means for 

1 5 establishing communications over the WAN 764, such as the Internet. The modem 

768, which may be internal or external, is connected to the system bus 718 via the 
serial port interface 752. In a networked environment, program modules depicted 
relative to the computer 712, or portions thereof, may be stored in the remote memory 
storage device 760. It will be appreciated that the network connections shown are 

20 exemplary and other means of establishing a communications link between the 

computers may be used. 

Fig. 8 illustrates an example system 800 that performs context awareness 
processing to facilitate identifying and establishing optimal communication 
modalities. The system 800 includes a communication manager 810 operably 

25 connected to a set 820 of possible communication modalities and a set 830 of 

information concerning how a communicating party would prefer to communicate and 
the context of the communicating party. The set 830 includes a communication 
preferences data store 840 and a context 850. The context 850 holds information 
collected from and/or inferred about context sources 860. The context sources can 

30 include, but are not limited to, calendar information 861 , video analysis 862, location 

863, accelerometer data 864, ambient acoustic information 865 and desktop events 
866. 

The context 850 may vary widely depending on the location and task of the 
contactee. For example, a first contactee in a car moving 85 m.p.h. during rush hour 
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is likely to have one context while a second contactee in a car moving 5 m.p.h. during 
rush hour is likely to have a different context. Similarly, a contactee piloting a jet 
fighter that is on autopilot, in clear skies, with no enemies within a thousand miles is 
likely to have a different context than a pilot currently engaged by surface to air 
5 missiles over enemy territory. Closer to home, a parent of grade school aged children 

at home during school hours on a school day is likely to have a different context than 
the same parent in the car with the school aged children ten minutes before school 
starts. 

The communication manager 810 examines the context 850 and the 

1 0 preferences 840 in light of the possible communication modalities currently available 

or likely to become available. The communication modalities can include, but are not 
limited to, a set 870 of desktops (e.g., person with more than one computer, person 
with alternate contacts (e.g., secretary, assistant)), a set 875 of room capabilities (e.g., 
person reachable in more than one meeting room, conference room, office), a cell 

1 5 phone 880 and a POTS telephone 885. After performing such analyses, the 

communication manager 810 is then available to engage or be engaged by other 
communicating parties employing the present invention, as illustrated in Fig. 9. 

Fig. 9 illustrates communicating parties employing the present invention and 
processing associated with a contactor attempting a communication. A connection 

20 manager 900 is operably connected to a contactor communication manager 910 and a 

contactee communication manager 920, where the contactor communication manager 
910 and the contactee communication manager 920 are examples of the 
communication manager described in association with Fig. 8. The connection 
manager 900 communicates with the contactor communication manager 910 and the 

25 contactee communication manager 920 to acquire information employed in 

determining the optimal communication that can be achieved between a contactor best 
means 930 for communicating and a contactee best means 940 for communicating, 
employing, for example, the methods described in association with Figs. 6 and 7. 

The contactor communication manager 910, after gathering information and/or 

30 making inferences concerning a context 965 (derived from a plurality of context 

sources 960), preferences 970 and capabilities 975 may transmit contactor schema 
950 to the connection manager 900. The schema 950 can hold information including, 
but not limited to, contactor identity, contactor history, registered documents, tasks, 
source modality, requested means and capabilities, for example. Similarly, the 
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contactee communication manager 920 may be queried, for example, by the 
connection manager 900 for information including, but not limited to, contactee 
context 985 (derived from a plurality of context sources 980), contactee preferences 
990 and contactee capabilities 995. It is to be appreciated that although the contactor 
5 communication manager 910 is described as transmitting data and the contactee 

communication manager 920 is described as being queried, that other data 
communication methods can be employed in accordance with the present invention. 

The present invention provides for interacting with hardware and/or software 
to automatically establish the identified connections. Thus, the contactor in Fig. 9 

1 0 may be able to make a first decision, that they would like to communicate with a 

contactee, select means for establishing the "best communication" and then wait for 
that "best communication" to be established. For example, a contactor word 
processing a document of interest to a contactee may select a revision in the document 
and be presented with a menu of options concerning the revision. One of the options 

1 5 may be a "BestCom" option to communicate with the contactee. The person may 

then select the "BestCom" option, whereupon analysis associated with the present 
invention would be initiated to establish communications with the contactee. Such 
processing may cause the contactor to be presented with situations including, but not 
limited to, display of information concerning a phone conversation being scheduled 

20 for later, presentation of a herald that indicates that a telephone call is being put 

through immediately, an Instant Messenger input field popping up, an email 
composition form popping up with the appropriate contactee(s) populating the To: 
field, for example. The situation experienced by the contactor may be based on the 
contactee' s preferences and context. 

25 As mentioned above, a communication modality and/or a contactee may not 

be immediately available. Thus, the present invention includes methods for 
predicting the likelihood of when contactee(s) may be available, where such 
likelihoods can be employed in scheduling group meetings where the utility of the 
group experience of n participants, n being an integer, is maximized. For example, 

30 calendars for the n participants can be examined to infer times at which the 

participants are likely to be available to share in some modality (e.g., 
videoconferencing, collaborative editing). Automated meeting request(s) can be 
constructed from such analysis. 
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It is noted that communications between contactors and contactees can occur 
between unknown parties and can be negotiated, if desired. For example, and as 
described above, communications can be established via decision-making processes in 
the contact manager and include communications preferences of the contactors and 
contactees. The processes can include utility-based decisions that enable 
communications to be established according to a value of the communications to the 
respective parties. To highlight these principles, Fig. 1 0 illustrates a contact system 
1000 and associated process for establishing communications between an unsolicited 
contactor 1010 and a contactee 1014 in accordance with an aspect of the present 
invention. 

At 1 020, a communications attempt is initiated by the unsolicited contactor 
1010 and directed to a contact manager 1024 or other intermediary system (e.g., e- 
mail service, on-line messenger service, on-line phone service, and so forth). The 
communications attempt can include an offer to communicate and be included, 
described and/or updated as part of a preferences database (not shown) associated 
with the unsolicited contactor 1010 (See e.g., preference database reference numeral 
264 in Fig. 2). The offer can include consideration and/or incentives for the contactee 
1 01 4 in order to induce a communication with the unsolicited contactor 1010. Offers 
and incentives can include a plurality of different forms and/or formats. For example, 
an offer can be directed such as "If you are willing to listen to, read, view, examine 
and/or interact with the following commercial, political ad, survey, infomercial or 
other type communication" then "You can receive the following incentive or 
consideration" (e.g., money, gifts, rebates, perks, discounts on other items and so 
forth). 

Proceeding to 1030, the contact manager 1024 analyzes contactee preferences 
(See e.g., preference database reference numeral 254 in Fig. 2) regarding potential 
communications with contactors. At 1034, a determination is made as to whether 
unsolicited communications should occur based upon the preferences analyzed at 
1 030. For example, if the contactee's preference is set or configured to prevent any 
communications from an unknown or unsolicited contactor 1 01 0, the process 
proceeds to 1040 wherein possible further communications are ended with the 
unsolicited contactor 1010. This can include sending communications or feedback via 
the contact manager 1024 to the unsolicited contactor 1010 indicating that further 
communications are not permitted or desired. 
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If unsolicited communications are acceptable at 1034, the process proceeds to 
1044, wherein the unsolicited contactor's offer to communicate is presented or 
delivered to the contactee 1014. At 1050, the contact manager 1024 and/or contactee 
1014 determines if the offer is acceptable. For example, contactee preferences can 
5 enable or describe a predetermined amount of messages to be received from a 

predetermined category or categories of message sources (e.g., OK to receive up to 10 
messages or communications a day from any music supplier if my on-line music 
account is updated to receive a free CD from the supplier). If the offer is acceptable 
at 1050 (can include explicit preference overrides, desires and/or indications of 

10 acceptance by contactee 1014), communications are then established at 1054 between 

the unsolicited contactor 1010 and the contactee 1014. It is to be appreciated that an 
agreement to communicate between parties can include an agreement for future 
communications and can include past considerations. 

If the offer to communicate is unacceptable at 1050, the process proceeds to 

15 1 060. At 1 060, the parties are given an opportunity to participate in a dialog session. 

If either party (contactor or contactee) decides not to engage in the dialog, then the 
process proceeds to 1040 wherein further communications are ended. If a dialog is 
desired at 1060, the process proceeds to 1064 enabling the parties to further negotiate 
or modify the original offer presented at 1 044 (e.g., discuss counter offer or 

20 modification from contactee 1014). The process depicted at 1050, 1060, 1064 can be 

repeated until communications are established at 1054 or communications are ended 
at 1040. 

The present invention as described above, facilitates management of 
unsolicited communications and increases the utility of such communications to the 

25 contactee 1014 while increasing the value of such communications to the contactor 

1010. The contact manager 1024, along with the preference databases, can be 
employed to control parameters such as time, place and manner that unsolicited 
communications of acceptable genres or types of communications are presented to a 
user or contactee. The contact manager 1 024 facilitates communications between the 

30 contactor 1010 (and/or group of contactors) and one or more contactees 1014 

concerning the parameters of the agreement between the parties regarding unsolicited 
communications. 

By way of illustration, in return for a consideration (e.g., free cellular phone 
service) the contactee 1014 may agree to receive a pre-determined amount of 
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unsolicited communications per month. The unsolicited communications can 
originate from various sources (e.g., car manufacturers, banks, credit card vendors), 
take different forms (e.g., cellular call, satellite call, POTs call, e-mail, paper mail, 
video call, fax, and so forth), be of varying length (e.g., short update, lengthy 
5 prospectus, very short reminder) and be presented at different times. Such various 

genres, forms and times may have different value to the unsolicited contactor 1010 
and provide different utilities to the contactee 1014. For example, a phone call before 
the market has opened in the morning may be worth five times as much as an e-mail 
after the market has opened and may be worth ten times as much as a fax as the 
10 market close approaches. Thus, an agreed upon pre-determined value of unsolicited 

communications may be received through a wide variety of combinations of received 
communications. 

To facilitate arranging an agreement between parties, in one example of the 
present invention, the contact manager 1024 can include an unsolicited 

1 5 communication agreement manager (not shown) and an unsolicited communication 

receipt tracker (not shown). The unsolicited communication agreement manager can 
be employed, for example, to arrange the parameters (e.g., preferred modalities, 
preferred times, preferred communication topics (e.g., stocks, news, mortgage rates), 
total value to unsolicited communicator, calculation period, and so forth)) of the 

20 agreement between the parties. The unsolicited communication receipt tracker can be 

employed, for example, to monitor properties such as the value of received 
communications and the remaining value required to satisfy the agreement. 

In one example of the present invention, the system 1000 may further include 
a consideration calculator (not shown) that can be employed, for example, to 

25 determine the amount of benefit that the contactee 1014 should receive from the 

unsolicited contactor 1010 based, at least in part, on the total value of unsolicited 
communications received during a calculation period. By way of illustration, 
although a first contactee can agree to receive unsolicited communications, the 
contactee may have been too busy during a calculation period to accept any such 

30 unsolicited communications. Thus, the consideration calculator can be employed to 

determine that the contactee should not receive any consideration. By way of further 
illustration, a second contactee may have received a large value of unsolicited 
communications during a calculation period and thus the consideration calculator may 
be employed to determine that the contactee should receive a bonus consideration 
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above and beyond as subscribed for consideration {e.g., gift certificate in addition to 
free cellular service). 

Although contactee's 1014 may initially identify preferred modalities (e.g., 
time, place, method) for receiving unsolicited communications, when an unsolicited 
5 communication is presented in accordance with such preferences, the contactee 1014 

can decide (e.g., configure preference), for example, to not receive the 
communication, to schedule it for a later time, to change the communication modality 
and/or to accept the communication as offered, for example. Thus, the contactee 1014 
has the opportunity to increase the utility of unsolicited communications, which in 

10 turn increases the value of the communication to the unsolicited contactor 1010. 

It is noted that the components described above for handling unsolicited 
communications can also be extended to include a contingency-based policy(s) and/or 
decision(s) that guide payment and reimbursement for handling uncertainty in the 
identity of the contactee 1014 and/or the content of the contactee's communication. 

15 With contingency-based policy, for example, unsolicited or unrecognized contactors 

1010 can be forced by default (e.g., via policy provided in preferences database) to 
provide payments or consideration to the contactee 1014 to access one or more 
modalities for communicating with that contactee 1014. However, efficient controls 
can be provided that enable the contactee 1014 to render the communication cost-free 

20 or less expensive for the contactor 1010 following the contactee's recognition of the 

contactor and/or following an analysis of the content of the communication. 

Such policies can enable various functionalities. For example, the 
contingency-based approach enables contactees 1014 to accept communications from 
contactors 1010 with whom the contactee's actually desire to communicate with, but 

25 who are not yet registered nor recognized as known entities. Thus, the system 1000 

enables access to the contactee 1014 at an upfront fee or other consideration that may 
be removed by permission of the contactee following recognition of the contactor 
1 0 1 0 by the contactee. 

Therefore, as an example, people or other contactors may not be registered as 

30 a recognizable identity in a database of people who can communicate - or 

communicate via particular channels (e.g., phone communication) and/or per 
particular contextual states of the contactee - with the contactee. Friends, family, and 
colleagues who are unrecognized by the system could gain access (and perhaps 
become registered for future payment - free access) by committing to pay "up front" 
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to gain access. However, these people can be reimbursed as soon as the contactee 
1014 recognizes the caller and decides to make the communication cost free. As 
another example, an unsolicited caller or contactor 1010 interested in doing targeted 
sales may pay to access a contactee 1014, yet be reimbursed for the cost of the 
communication given a successful sales or, more generally, a decision of the 
contactee 1014 to reduce or remove the default payment made up front by the 
contactor 1010 for accessing the contactee 1014. This can occur, for example, if the 
contactee 1014 determines that the call, service and/or content that stemmed from the 
communication is actually desired after contact is made. 

It is to be appreciated that aspects of the present invention maybe embodied in 
a computer readable medium such that a computer readable medium can store 
computer executable components for a system that facilitates communication between 
entities in accordance with the present invention. For example the computer 
executable components can comprise an identifying component that identifies a 
plurality of communication modalities that respectively provide for communication 
between at least two entities. Furthermore, the computer executable components can 
comprise an analyzing component that analyzes a first communication data set 
associated with a first entity and a second communication data set associated with a 
second entity, the analyzing component identifying one or more communication 
modalities of the plurality of modalities based at least in part on analysis of the first 
and second communication data sets and the analyzing component establishing a 
communication between the entities. 

What has been described above includes examples of the present invention. It 
is of course, not possible to describe every conceivable combination of components or 
methodologies for purposes of describing the present invention, but one of ordinary 
skill in the art may recognize that many further combinations and permutations of the 
present invention are possible. Accordingly, the present invention is intended to 
embrace all such alterations, modifications and variations that fall within the spirit 
and scope of the appended claims. Furthermore, to the extent that the term "includes" 
is used in either the detailed description or the claims, such term is intended to be 
inclusive in a manner similar to the term "comprising", as comprising is interpreted as 
a transitional word in a claim. 



44 



WO 02/075495 



PCT/US02/07894 



Claims 

What is claimed is: 

5 1 . A system to facilitate communications between parties, comprising: 

a first component associated with a request for attentional resources of a 
contactee; and 

a second component that facilitates a response to the request based in part on the 
utility of the request to the contactee. 

10 

2. The system of claim 1, the first component is a contactor data store that includes 
preferences of a contactor relating to the request, the second component is a contactee 
data store that includes preferences of the contactee relating to at least one of the request 
and the response. 

15 

3. The system of claim 2 5 further comprising a contact manager to facilitate 
communications between the contactor and the contactee based in part on the preferences 
of the parties, the request and the response. 

20 4. The system of claim 2, the request includes at least one of the contactor's 

capabilities, goals, tasks, schedules, priorities, deadlines, costs, and benefits in order to 
maximize the utility to the contactee. 

5. The system of claim 2, the response including at least one of the capabilities of 
15 the contactee, the contactee's preferences relating to the contactor's preferences and how 

the contactee prefers to be contacted, the preferences of being contacted varying in 
respect to the contactor over at least one of time and topics of communication. 

6. The system of claim 5, the contactee restricts communications of a selected group 
50 of contactor's over time via at least one of actions by the contactee and by modifying the 

preferences in the contactee preferences data store. 
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7. The system of claim 2, the contactor optimizes at least one of a measure of 
priority and a measure of value to facilitate communications between the parties. 

8. The system of claim 3, the contact manager optimizes at least one of a measure of 
priority and a measure of value to facilitate communications between the parties. 

9. The system of claim 2, the preferences of at least one of the contactor and the 
contactee including at least one of a time of day for communicating, a time of week for 
communicating, identity of the contactor that includes the identity of unknown 
contactors, hardware currently available, hardware available within a time horizon of a 
communication attempt, software available, and interruptability information. 

10. The system of claim 2, the contactee data store including dynamically changing 
communication information relating to needs of the contactee. 

11. The system of claim 3, the contact manager facilitates communications between at 
least one of multiple parties and multiple communications channels. 

12. The system of claim 3, the contact manager enabling a dialog session between the 
contactor and the contactee to facilitate communications between the parties. 

13. The system of claim 3, the contact manager informs the contactee of the 
contactor's attempt to communicate, the contactee is provided with an opportunity to 
override current preferences in the contactee data store based on current capabilities of 
the contactee. 

14. The system of claim 3, the contactee is presented a list of options for being 
contacted via the contact manager. 
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1 5. The system of claim 3, the contactor is presented with a list of communications 
options with high utilities determined in accordance with the preferences of the contactee 
via the contact manager. 

1 6. The system of claim 3, the contact manager is operably associated with at least 
one of an e-mail, a video transmission, a television transmission, a telephone, a mobile 
communications device, an instant message and a computing device. 

1 7. The system of claim 3, the contact manager including at least one of a set of rules, 
a set policies, and decision-theoretic formulae to facilitate communications between the 
parties. 

18. The system of claim 17, the decision-theoretic formulae including the following 
equation: 

A* = arg max ^ ^(context* i \ E) x u(Aj ,A£,C 9 context R /,context c ) 

3 i 

Aj is a communication modality being considered; 

A C a is a communication modality employed by the contactor; 

context^ is a context of the contactee; 

context 0 is a context of the contactor; 

C is an identity of the contactor; and 

^(context^i | E) is a conditional probability that the contactee has a certain context 
given the evidence E and is employed with a utility function u to determine ideal 
communication actions that maximize the utility of communications between the 
contactor and the contactee. 
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19. A method to facilitate communications between parties, comprising: 

communicating a first set of preferences to send information; 
communicating a second set of preferences to receive the information; and 
enabling communications between two or more parties based at least in part on 
the preferences. 

20. The method of claim 19, further comprising transmitting one or more selection 
options from a first party requesting attentional resources of a second party, the 
communications between the parties based at least in part on the selected option. 

2 1 . The method of claim 20, further comprising, 

enabling at least one party to override the preferences in order to receive further 
communications from the first party. 

22. The method of claim 19, further comprising, 

transmitting a list of options to at least one party, the list arranged according the 
communications preferences of at least one other party. 

23. The method of claim 19, further comprising, 

enabling a dialog session between the parties to facilitate further communications 
between the parties. 

24. A computer-readable medium having computer-executable instructions for 
performing the acts of claim 19. 

25. A system to facilitate communications between parties, comprising: 

means for specifying preferences to send and receive communications; 

means for transmitting one or more selection options requesting the attention of 
at least one party via the communications; and 

means for enabling further communications between the parties based at least in 
part on the preferences and the selected option. 
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26. A signal to establish communications between at least two entities, comprising: 
a data packet comprising: 

a first data field representing a request for attentional resources of a 
contactee; and 

5 a second data field representing a response to the request, the response 

relating to the willingness of the contactee to engage in communications based 
upon the utility of the request to the contactee. 

27. A computer-readable medium having stored thereon a data structure to represent 
10 message contact data, comprising: 

a first field representing a contactor's preferences associated with a request for 
the attention of a contactee; and 

a second field representing the contactee's preferences associated with 
responding to the request, the contactee's preferences communicating the contactee's 
1 5 desire for further communications based on the vaJue of the request. 

28. A system to facilitate unsolicited communications between parties, comprising: 

a contact manager to transmit an offer to communicate from an unknown 
contactor to a contactee; and 
20 a preference component associated with the contactee to enable an acceptance 

of the offer based in part upon consideration presented in the offer. 

29. The system of claim 28, further comprising a preference component associated 
with the unknown contactor to describe one or more parameters of the offer. 

25 

30. The system of claim 28, the offer includes a request to at least one of listen, view, 
examine and interact with at least one of a commercial, political ad, survey, and 
infomercial. 

30 31. The system of claim 28, the consideration includes at least one of money, gifts, 

rebates, perks, and discounts on other items. 
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32. The system of claim 28, the contact manager automatically disables further 
communications with the unknown contactor based upon settings in the preference 
component associated with the contactee. 

33. The system of claim 32, the contact manager provides feedback to the unknown 
contactor indicating whether communications are established with the contactee. 

34. The system of claim 28, at least one of the contact manager and the contactee 
enable further communications via acceptance of the offer. 

35. The system of claim 34, the acceptance includes an agreement to communicate in 
the future. 

36. The system of claim 34, the acceptance is based upon past consideration. 

37. The system of claim 28, the preference component enables a predetermined 
amount of messages to be received from a predetermined number of message sources. 

38. The system of claim 28, the contact manager enables a dialog session to facilitate 
an agreement to communicate between the unknown contactor and the contactee. 

39. The system of claim 28, further comprising an agreement component to at least 
one of arrange parameters, modalities, times, topics, and value between the unsolicited 
contactor and the contactee. 

40. The system of claim 39, further comprising a receipt component to monitor 
properties of the agreement between the unsolicited contactor and the contactee. 

41 . The system of claim 40, further comprising a consideration calculator to adjust 
one or more parameters of the agreement. 
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42. A method to facilitate communications between unknown parties, comprising: 

transmitting an offer having at least one incentive to induce communications 
between parties; 

analyzing preference data associated with at least one of the parties; and 
5 establishing communications between the parties based at least in part on the 

preference data, the at least one incentive, and actions between the parties. 

43. The method of claim 42, further comprising determining whether to present the 
offer to one of the parties based on the preference data. 

10 

44. The method of claim 43, further comprising disabling further communications 
between the parties based on the preference data. 

45. The method of claim 42, further comprising providing feedback to at least one of 
1 5 the parties regarding the ability of the other party to communicate. 

46. The method of claim 42, further comprising establishing a dialog to enable further 
negotiations of the offer. 

10 47. A computer-readable medium having computer-executable instructions for 

performing the acts of claim 42. 

48. A system to facilitate communications between unknown parties, comprising: 
means for transmitting an offer to induce communications between parties; 
25 means for analyzing preference data associated with at least one of the parties; 

means for establishing communications between the parties based at least in part 
on the preference data and actions between the parties; and 
means for negotiating the offer. 

30 
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49. A method to facilitate communications between unknown parties, comprising: 
executing one or more contingency-based policies that guide payment and 

reimbursement to handle uncertainty in at least one of an identity of a contactee and 
content relating to communications with the contactee; and 

forcing contactors to provide consideration to the contactee to access one or more 
modalities for communicating with the contactee. 

50. The method of claim 49, further comprising providing controls that enable the 
contactee to render the communications less expensive upon the contactee's recognition 
of the contactor. 

5 1 . The method of claim 49, further comprising providing controls that enable the 
contactee to render the communications less expensive upon following an analysis of the 
content of the communication. 

52. The method of claim 49, further comprising accepting communications from 
contactors who are not recognized as known entities. 

53. The method of claim 52, further comprising providing access to the contactee 
based upon an upfront consideration that may be removed by permission of the contactee 
following recognition of the contactor. 

54. The method of claim 52, further comprising reimbursing the contactor for the cost 
of the communication via a decision of the contactee to reduce the upfront consideration. 
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